Exponential localization of singular vectors in spatiotemporal chaos 
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In a dynamical system the singular vector (SV) indicates which perturbation will exhibit maximal growth 
after a time interval r. We show that in systems with spatiotemporal chaos the SV exponentially localizes in 
space. Under a suitable transformation, the SV can be described in terms of the Kardar-Parisi-Zhang equation 
with periodic noise. A scaling argument allows us to deduce a universal power law r ' for the localization of 
the SV. Moreover the same exponent 7 characterizes the finite-r deviation of the Lyapunov exponent in excellent 
agreement with simulations. Our results may help improving existing forecasting techniques. 
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I. INTRODUCTION 

Lyapunov analysis is one of the main tools to quantitatively 
characterize dynamical systems |[l|]. In particular, the largest 
Lyapunov exponent (LE) A is a fundamental quantity that al- 
lows one to address, at some basic level, the question of the 
predictability of a system. A positive A implies chaotic behav- 
ior: neighboring initial conditions diverge in time at an expo- 
nential rate ^ exp(Ai). Actually, the LE is an asymptotic 
magnitude in the sense that it is defined in the infinite-time 
limit. 

However, it has been since long recognized that the infinite- 
time limit is often iiTelevant to address many important ques- 
tions. Therefore, the finite-time LE (to be defined below) was 
introduced as an essential tool to deal with problems such as 
predictability |2] and shadowability f3^ of dynamical systems. 
Correspondingly, the singular vector (SV) (also referred to as 
the finite-time Lyapunov vector) is defined as the perturbation 
that will show the maximal expansion after some finite time t. 

Singular vectors are typically used in operative models for 
weather prediction |4, 5]. Every day the ECMWF (European 
Centre for Medium-Range Weather Forecasts) |6] computes a 
set of singular vectors to perform an ensemble forecasting of 
the European weather |4]. Also, in a different context, SVs 
have been found to be useful to study advection of passive 
particles in fluids |7]. 

It is a well-known result fs*] that as the the time horizon r 
increases the SV exponentially approaches the so-called for- 
ward Lyapunov vector (FLY) For low dimensional sys- 
tems our understanding in these simple terms might be satis- 
factory. However, in extended systems it is clear that spatio- 
temporal coiTelations should have an important effect in the 
way this limit is achieved. How this convergence of the SV 
toward the FLV occurs and what generic system-independent 
features (if any) exist are important open questions in the case 
of chaotic extended systems. Indeed, this is also of practi- 
cal and theoretical importance in the field of atmospheric sci- 
ences ifTolfTlll . because it is directly related with the problem 
of realistic forecasting within a given finite time horizon t. 

In this paper we analyze the structure of the SV in extended 
systems with spatiotemporal chaos. We show that the SV lo- 
calizes exponentially in space around one center (determined 
by the present state of the system and by the horizon r). We 
find that the localization strength generically scales with the 



observation time as a power-law t~'^. Moreover, we pro- 
pose a stochastic field-theoretical description of the evolution 
of the SV, which allows us to give an analytical prediction 
for the universal exponent 7 and the finite-r deviation of the 
LE, in good agreement with simulations in systems of dif- 
ferent natures, including coupled-map lattices and differential 
equations. Numerical results together with general scaling ar- 
guments suggest our results are generic for a wide class of 
systems exhibiting space-time chaos. 



II. BASIC DEFINITIONS 

For any given dynamical system, infinitesimal perturba- 
tions Su{t) are governed by linear equations (tangent space) 
such that the perturbation after some r can be expressed via 
a linear operator (resolvent or propagator): Su{t + r) = 
M{t + T, t)du{t). 

We are interested here in the SV, which is defined as the 
perturbation in tangent space at time t that gets amplified the 
most at some future time t + r. In a more mathematical form, 
let Sr{t) denotes the SV for a time horizon r, then we have 



{M{t + T, t)Su{t) ■ M{t + T, t)6u{t)) 
{Su{t) ■ Su{t)) 



St (t) = arff max 

Su(t) 

(1) 

where (x-y) denotes the scalar product. The "optimal" pertur- 
bation Sr{t) is the SV and it depends on both the time t (that 
determines the present state of the system), and the optimiza- 
tion time T. Using the adjoint operator M* {t + r, t) defined 
by (M(t + T, t)Su{t) • M(t + T, t)5u{t)) = {5u{t) ■M*{t + 
T, t)'M.{t + T, t)Su{t)), the problem posed in Eq. ([U can be 
solved by finding the eigenvector of M*(t + r, i)M(t + r, t) 
with the largest eigenvalue (all of them are real and positive). 
For the Euclidean scalar product used throughout this paper 
we have M* = M'^. 

The iterative application of the operator + r, t) = 
M*(i + T, <)M(t + T,t) to an arbitrary vector (the power 
method), generically converges to the wanted eigenvec- 
tor Srit), which satisfies the eigenvalue problem ^{t + 
T,t)sr{t) = fj,T{t)sT{t). Then, the finite-time LE is typi- 
cally defined as Xr{t) = (2t)"1 InAir(i) SSI [11, which 
depends on t and on the optimization time r. According to 
Oseledec's theorem ifTill in the limit r ^ 00 with probability 
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one Ar (i) converges to a time-independent quantity- namely, 
the largest LE of the chaotic attractor lim^-^oo \ {t) = A. An 
important observation is in order: A is usually obtained from 
the evolution of a perturbation grown from the past, instead 
of considering how a perturbation will evolve in the future. 
Thus a perturbation evolved since the remote past is the "most 
unstable" eigenvector of M(t, — oo)M*(i, —oo) fT3], which 
has been called backward Lyapunov vector (BLV) [9]. Con- 
versely, the FLV is eigenvector of M*(cx), t)M(cx), t). 

In order to gain some numerical insight into the problem 
we have studied the behavior of the SV in two prototypical 
dynamical systems exhibiting spatiotemporal chaos. The first 
example we consider is a CML in a ring, which is discrete in 
space (x = 1, . . . ,L) and time {t = 0,1, . . . , oo): 

uAt + 1) - e/(u.+i(<)) + e/K_i(t))+ 

+ {l-2e)fiu4t)), (2) 

with the logistic map f{g)— 4p(l — g), and coupling strength 
e = 1/3. 

The second model we consider here is an example of a 
chaotic system described by differential equations. We study 
the model proposed by Lorenz in 1996 (L96) |16] as a toy 
model in the context of weather dynamics. We consider the 
variables yx defined in a ring geometry, and the evolution 
equations 



d 

dt 



Vx 



-yx - Vx~i{yx-2 - Vx+i) + F. 



(3) 



with F = 8. We used the Euler method for the integration 
with M = 10"''. 



III. SINGULAR VECTOR SURFACE: LOCALIZATION, 
PATTERNS AND CORRELATIONS 

An important feature of singular and Lyapunov vectors is 
that their amplitudes are much localized in space. Localiza- 
tion of SVs was observed long time ago in simple meteoro- 
logical models lfl2[ ITtIi . however, to our knowledge, a de- 
scription of the localization profile in space or the dynamics 
does not exists even at a qualitative level. In contrast, the lo- 
calization properties of the BLV are much better understood. 
Pikovsky et al. ^ [H demonstrated that, in a large class 
of one-dimensional systems with spatiotemporal chaos, the 
BLV can be mapped into a roughening surface that belongs to 
the universality class of the Kardar-Parisi-Zhang (KPZ) equa- 
tion ll20ll . The solutions of the KPZ equation present universal 
scaling exponents in space and time |20]. In particular, and 
as a result, one can conclude that the BLV in one dimension 
is sub-exponentially localized, with its magnitude decaying 
in space as ~ exp(— fc^/x) from the localization site. These 
results apply to the FLV as well because the operator M* has 
the same coarse-grained long-scale structure than M, and thus 
the FLV surface belongs to the KPZ universality class too. 

The spatial structure of a Lyapunov vector is better resolved 
by making a logarithmic transformation | isl [HI lU |2^. In 
the same spirit, expressing the vector components as [t) = 
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FIG. 1: (Color online) (a) SV surfaces of the CML model for dif- 
ferent values of r (L = 1024). Curves have been shifted to improve 
their visibility, (b) Structure factor for different values of r (averaged 
over 500 realizations). 



[sr{x, we define a SV surface via the Hopf-Cole trans- 

formation: hr{x,t) = ln\sT-{x,t)\. In this representation 
the finite-T LE becomes the average velocity of the surface: 
A,(<) = (ri)-i ELi In I [M(t + r, t)sr{x, t)]/sr{x, t)\. 

Figure [TJ a) shows typical SV surfaces for different values 
of T in the case of the CML model (|2]). We obtained sim- 
ilar behavior for the L96 model We observe that for t 
larger than some threshold Tx (L) the corresponding surface 
has approximately a random-walk profile; or in terms of the 
SV itself we have stretched-exponential localization for a a 
time horizon t ^ (L), as anticipated above. Remarkably, 
for T < Tx (L) we find that the height profile of the SV sur- 
face is facetted with superimposed fluctuations at small scale. 
Note that a triangular SV surface corresponds to an exponen- 
tial localization of the SV. 

The triangular pattern progressively dies out for longer 
times r. This means that the asymptotic convergence to the 
FLV is reached for practical purposes in a finite time: when 
we look for the perturbation at present time t that will ex- 
hibit the largest amplification at a future time t + t, there is 
a characteristic time Tx (L) that separates the genuine finite- 
time regime from the quasi-infinite-time regime. In the latter 
regime (r > Tx) the SV has almost collapsed into the FLV. 

Quantitative information about the spatial correlations of 
the SV can be obtained calculating the structure factor: 
Sr{k) = limt^oc{hT{k,t)hr{—k,t)), where hr{k,t) — 
L"^!"^ ^t{x, t) exp{ikx), and the bracket indicates aver- 
age over realizations. Figure [Ttb) shows the results for dif- 
ferent values of the temporal horizon r. For large r, one 
recovers the typical spatial coiTelations coiTesponding to the 
FLV, Sr{k) ~ fc^^, as expected from the previous discus- 
sion. Contrastingly, for r < Tx{L) we find Sr{k) ~ fc~^ 
at small wave numbers (due to the symmetry of the triangular 
profile only wavenumbers fc„ — 2TTn/L with n odd contribute 
significantly to the structure factor). The coarse-grained 
slope of the triangle a, and the surface width W^{L) — 
L^^ J2x hrix, ty — [L^^ Yl,x hrix, t)]'^ servc to quantify the 
localization strength. The following relation holds for small k 
and T < Tx (L): 



Sr{kn ^ 0) 



16(a2 



768{W^iL)) 
L^ki 



for n odd. 
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FIG. 3: (Color online) (a) Asymptotic solutions of the PNKPZ equa- 
tion for different values of r (L = 1024). Curves are arbitrarily 
shifted to improve their visibility, (b) Structure factors for different 
values of r (averages were done over 500 realizations). 



FIG. 2: (Color online) Structure factor of the eigenvectors of M* 
and MJMr for r = 160 in the CML model after average over 500 
realizations. The long scale structure (small k) of the eigenvector of 
M!!^Mr is well captured by the eigenvector of M* alone. 



IV. STOCHASTIC FIELD THEORY FOR SINGULAR 
VECTORS 

SVs are the asymptotic vectors computed by repetitive ap- 
plication of the operator *(t+r, t) = M.*{t+T, t)M(i+T, t), 
to an arbitrary initial vector This makes the SV similar, 
albeit not exactly equivalent, to the BLV of a periodic or- 
bit. In fact, for temporally periodic but spatially chaotic 
states the evolution in tangent space is mapped exactly onto 
an one-dimensional localization problem and it can be rigor- 
ously proved that all the eigenvectors are exponentially local- 
ized |23i]. For the FLV to be computed, and because of the 
T ^ oo limit, only the M* operator needs to be used ifTsll . 
However, the structure of the operator $ is obviously differ- 
ent from that of M*. In Fig.|2]we compare the structure fac- 
tors obtained with the example of the CML when computing 
the surfaces associated to the eigenvectors of ^'(< + r, t) (the 
actual singular vector) and M* {t + r, t) (which can be viewed 
as the BLV of an unstable periodic orbit of period r). One 
may see that, in statistical terms, the large length scale behav- 
ior of the main eigenvector of $(t + r, t) is well reproduced 
using operator M*(t + r, t) alone. This fact justifies consid- 
ering a minimal model (for the long scale structure of the S V) 
consisting of a stochastic equation with periodic noise. 

We now write a minimal Langevin model to understand in 
the simplest terms the structure of the SV surface on long 
wavelengths. We propose a modification of the KPZ equation 
considering a periodic noise (PNKPZ): 

dthr{x,t) = Cr{x,t) + [d,hr{x,t)Y + d^^hr[x,t), (4) 

where one simply assumes to be a random noise with 
period r {i.e. C,r{x,t) — Crixjt + t)] and a (5-correlator, 
{Crix,t)Crix',t')) = 2a 6{x-x')S{t-f), for \t-t'\ < r. 

Figure [3] shows the results of our numerical integration of 
Eq. (IDl; space and time were discretized (Aa; = lOOAt = 1) 
and a noise intensity (7 = 0.5 was used. Other intensities can 
be used and this, of course, has no effect on the results. One 
can see that the solutions of (|4|i adopt a triangular pattern, akin 
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FIG. 4: (Color online) (a,b) Surface width vs. r. (a) SVs of CML 
and L96 models for L = 4096 and L = 512, respectively, (b) 
PNKPZ for L = 1024. (c,d) Finite-r deviation of the LE. Data of 
the L96 model have been shifted two decades downwards to avoid 
overlap of data sets. In all panels symbols mark mean values, and 
bars indicate the statistical dispersion (100 realizations were done 
for the L96 model and 500 for the other models). 



to those shown in Fig.[T]for the S V surface of the deterministic 
model. The triangular structure flattens as t increases and 
eventually disappears above some threshold value Tx (L). 

In Fig. |4ja,b) we plot the surface width as a function 
of T. Figure Ua) was generated from the SV surfaces of the 
chaotic systems in Eqs. (|2]i-(l3]i, while Fig. |4jb) was obtained 
from the numerical integration of the stochastic PNKPZ equa- 
tion (HJl. For not too large values of r we find a region of scal- 
ing where the width is dominated by the triangular structure. 
We find 

The values of r with a 95% of confidence are: 7 = 0.78±0.01 
for the CML, 7 = 0.81 ± 0.03 for the L96 model, and 7 = 
0.78 ± 0.01 for the PNKPZ equation. This strongly suggests 
that 7 is a universal exponent. 

In all cases we expect the scaling to break down for large 
T, as can be inferred from the fact that the stochastic model 
dUi converges to the KPZ problem as r 00. This translates 
into the convergence of the SV to the FLV as the time horizon 
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T tends to infinity. The existence of the characteristic time 
Tx {L) means that the FLV is virtually reached in a finite time 
for a finite-size system. 

For the theoretical analysis to follow, it is worth to re- 
mark that triangular solutions also appear in the case of 
the quenched columnar KPZ (QCKPZ) equation discussed 
in Ref. f2^, that corresponds to Eq. (|4| but with the peri- 
odic noise C,{x, t) replaced with a quenched columnar disor- 
der Cix). Note that in the limit t ^ of the PNKPZ equation 
[cf. ©I one recovers the QCKPZ equation. However, for a 
finite r correlations spread and one may conjecture that the 
problem can be seen effectively as a QCKPZ equation where 
the disorder ({x) has a finite correlation length. The asymp- 
totic solutions of the QCKPZ equation have been described 
as a triangular pattern (with superimposed random fluctua- 
tions) and exhibit scale-invariant roughness {W^^q{L)) ^ 

The existence of these two limiting dynamics — namely, 
KPZ for T ^ cx) and QCKPZ for r ^ 0— describes the 
behavior of the PNKPZ equation and can be exploited to de- 
rive an analytical expression for the exponent 7 by resort- 
ing to scaling arguments as follows. On the one hand, the 
width of the PNKPZ surface should scale as {W^{L)) ^ 
2^2qkpz fQj- ^ ^ j-^-)^ should make a crossover to 

{W^{L)) - l2"Qc^-7 for T < rx(L). Therefore, these 
two limiting behaviors are separated by the crossover time 
Tx(L) ^ i2(aQc-aKPz)/7, Qn the Other hand, the charac- 
teristic time Tx (L) should also correspond to the typical time 
that an initially flat KPZ surface needs to reach the statisti- 
cally stationary regime in a system of size L, so we have 
Tx{L) ^ Xj^kpz 1I20I1 . Equating both expressions we arrive 
at 

2(aQC - okpz) 

7 = 1 (5) 

zkpz 

which is in principle valid in any dimension and can be com- 
pared with our numerical simulations. Inserting the critical 
exponents in one dimension — cukpz = 1/2 and zkpz = 
3/2 12Q0; and age = 1.07 ± 0.05 fMl— we get 7 = 
0.76±0.07 in good agreement with our simulations (our direct 
estimation of aqc for the PNKPZ equation (|4|i with t ~ 16 
yields aqc = 1.08 ± 0.02, so 7 = 0.78 ± 0.03). 

V. FINITE-TIME LYAPUNOV EXPONENT 

A very interesting outcome of our analysis is the ex- 
istence of a scaling law for the finite-time LE. The av- 
erage velocity of the PNKPZ surface satisfies Xr{t) = 
{L~^ {dxhr{x, t))'^)r, where in good approximation the 
noise term has been assumed to average out within a period. 
Existing results on QCKPZ [24] indicate that there is a com- 
plete separation in two independent components such that h 
can be constructed as the sum of a triangular pattern with a tilt 
±ax and the solutions in r 00. After some algebra, one 



obtains 

(K) A = (a^) = i8L-'i(W^) - {W^^^)) (6) 
In Fig. lUd) we test the validity of this expression by plot- 
ting At- — A as a function of r. The dashed line arises in- 
serting in ^ the mean values of depicted in Fig. |5b). 
The straight line is computed by inserting in the dominant 
contribution A8L^'^{W^) the fitting power law in Fig. |4|b): 
(VK^)j.^ — 3.4x 10^ r^''-^^. The agreement is, in our opinion, 
very good taking into account the simplicity of our arguments. 

For a generic system with spatiotemporal chaos we may 
not expect to be able to obtain a formula relating the width of 
the SV surface and the finite-r deviation of the LE, but still 
we may ask whether the t ' dependence is observed. Fig- 
urelUc) indicates that this scaling for the LE exists in the same 
region where (W^) ^ t^^ , although the result is not conclu- 
sive for the L96 model because computer limitations did not 
allow us to study larger systems. Finally, we point out that for 
T > Tx (L) the convergence of Ar to A becomes faster, pre- 
cisely as ~ in accordance with the standard asymptotic 
behavior for low-dimensional systems |8]. This means that 
the spatial degrees of freedom slow down the convergence to 
the LE in extended dynamical systems as compared with the 
low-dimensional case. 



VI. CONCLUSIONS 

We have shown that for a large family of systems the SV 
exhibits exponential localization. We claim that this spatial 
structure can be described in terms of the solutions of the 
a stochastic equation, related to KPZ equation, in which the 
noise is periodic or quenched. In terms of the associated sur- 
faces, the SV converges toward the FLV following a power 
law with a universal exponent —7 given by Eq. (|5]). In particu- 
lar, for one-dimensional systems one has 7 ~ 0.78. Moreover, 
the same exponent characterizes the finite-time deviation of 
the LE. Even for spatio-temporal chaotic systems whose BLV 
(and FLV) does not belong to the universality class of KPZ, as 
occurs with Hamiltonian lattices |25], one may expect a qual- 
itative similarity with the scenario presented in this work, but 
possibly with different exponents. 

In forecasting applications t is the control parameter to cal- 
ibrate the ensemble of S Vs. Our results show how r quantifies 
(through the universal exponent 7) the localization strength, 
and the exponential growth rate. 
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